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METHOD, SYSTEM, AND PROGRAM FOR MANAGING 
DATA READ OPERATIONS 
BACKGROUND OF THE INVENTION 
Field of the Invention 
[0001] The present invention relates to a method, system, and program for 
managing data read operations including iSCSI data read operations. 

Description of the Related Art 

[0002] In a network environment, a network adapter on a host computer, such 
as an Ethernet controller, Fibre Channel controller, etc., will receive Input/Output (I/O) 
requests or responses to I/O requests initiated from the host. Often, the host computer 
operating system includes a device driver to communicate with the network adapter 
hardware to manage I/O requests to transmit and receive over a network. The host 
computer may also implement a protocol which packages data to be transmitted over the 
network into packets, each of which contains a destination address as well as a portion of 
the data to be transmitted. Data packets received at the network adapter are often stored 
in a packet buffer. A transport protocol layer can process the packets received by the 
network adapter, and accesses any I/O commands or data embedded in the packet. 

[0003] For instance, the computer may implement the Transmission Control , 
Protocol (TCP) and Internet Protocol (IP) to encode and address data for transmission, 
and to decode and access the payload data in the TCP/IP packets received at the network 
adapter. IP specifies the format of packets, also called datagrams, and the addressing 
scheme. TCP is a higher level protocol which establishes a connection between a 
destination and a source. Another protocol, Remote Direct Memory Access (RDMA) 
establishes a higher level connection and permits, among other operations, direct 
placement of data at a specified memory location at the destination. Another high level 
protocol is the Internet Small Computer Systems Interface (iSCSI) protocol which is 
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designed to transport SCSI commands and data over an IP network between an Initiator 
device such as a client, and a Target device such as a server. 

[0004] The term "iSCSI" refers to the protocol defined and described by the 
IETF (Internet Engineering Task Force) standards body, and any variant of that protocol. 
5 One example of an iSCSI packet configuration comprises an Ethernet package 
encapsulating an Internet Protocol (IP) and Transmission Control Protocol (TCP) 
package layers, which fiirther encapsulate an iSCSI package that includes one or more 
SCSI commands. In network data transmission operations, an initiator device transmits 
data or commands over the network to a target device. The TCP/IP package includes 

10 error correction code to determine whether the transmitted packet has changed during the 
transmission as the packet passes through switches and routers. Both an initiator of such 
an iSCSI command and the target generally can accommodate the Ethernet, TCP/IP, and 
iSCSI protocols when processing each part of the transmitted package. The target device, 
upon receiving the packet, will use the Ethernet protocol to access the TCP/IP package, 

15 the TCP/IP protocol to access the iSCSI package, and iSCSI protocol to access the SCSI 
commands within the iSCSI package. 

[0005] A target device such as a server, storage controller or host computer, for 
example, often includes an iSCSI target controller or subsystem to access the SCSI 
commands within the iSCSI package, and to perform the SCSI commands. For example, 

20 if the SCSI command is a read command, the iSCSI target controller can read data from a 
target address specified in the read command from storage coupled to the target device. 
Data is often stored in non- volatile storage units such as disk drives and tape units which 
tend to be relatively slow as compared to non- volatile memory such as random access 
memory (RAM). Hence, in some prior target devices, the target controller may have a 

25 cache in which a cache manager can temporarily store data in anticipation that the 
cached data may satisfy the next read operation in the queue. 

[0006] There are a number of data caching techniques including "read-ahead" 
techniques in which more data than is needed to satisfy the presently pending read 
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request, is cached in the cache. The particular caching technique used may depend upon 
the application being performed. For example, in a backup operation, the data read from 
the storage unit tends to be read in a linear fashion. Hence, data may be cached for 
efficient read operations by caching data from the storage unit in sequential order. 
5 [0007] Protocol layers such as the transport layer can be performed by host 

software such as the network adapter device driver, an application or the operating 
system. However, software such as a driver for a network adapter, can utilize significant 
host processor resources to handle network transmission requests to the network adapter. 
One technique to reduce the load on the host processor is the use of a TCP/IP Offload 

10 Engine (TOE) in which TCP/IP protocol related operations are implemented in the 

network adapter hardware as opposed to the device driver or other host software, thereby 
saving the host processor from having to perform some or all of the TCP/IP protocol 
related operations. In addition, the offload engine can perform certain iSCSI protocol 
related tasks. For example, the Intel PRO/ 1000 T IP Storage Adapter, can perform error 

1 5 checking of an encapsulated iSCSI packet using the iSCSI error checking codes, before 
the iSCSI packets are forwarded to the iSCSI target cortroller for extraction and 
processing of the SCSI commands. 

[0008] Notwithstanding, there is a continued need in the art to improve the 
performance of data transfer operations. 

20 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] Referring now to the drawings in which like reference numbers 
represent corresponding parts throughout: 

FIG. 1 illustrates one embodiment of a computing environment in which aspects of 
5 the invention are implemented; 

FIG. 2 illustrates a prior art packet architecture; 

FIG. 3a illustrates a prior art iSCSI header architecture for a SCSI initiator command; 
FIG. 3b illustrates a prior art iSCSI header and data section architecture for a SCSI 
target response; 

10 FIG. 4 illustrates one embodiment of a cache for use with a network adapter having a 
microengine for performing iSCSI related tasks in accordance with aspects of the 
invention; 

FIGs. 5 and 6 illustrate one embodiment of operations performed to process SCSI 
read commands using a network adapter microengine in accordance with aspects of the 
1 5 invention; and 

FIG. 7 illustrates an architecture that may be used with the described embodiments. 
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DETAILED DESCRIPTION OF THE ILLUSTRATED EMBODIMENTS 
[00010] In the following description, reference is made to the accompanying 
drawings which form a part hereof and which illustrate several embodiments of the 
present invention. It is understood that other embodiments may be utilized and structural 
5 and operational changes may be made without departing from the scope of the present 
invention. 

[0001 1] FIG. 1 illustrates a computing environment in which aspects of the 
invention may be implemented. A computer 102 includes one or more central 
processing units (CPU) 104 (only one is shown), a memory 106, non- volatile storage 

10 108, an operating system 1 1 0, and a network adapter 112. An application program 1 1 4 
further executes in memory 106 and is capable of transmitting and receiving packets from 
a remote computer. The computer 102 may comprise any computing device known in 
the art, such as a mainframe, server, personal computer, workstation, laptop, handheld 
computer, telephony device, network appliance, virtualization device, storage controller, 

1 5 network controller, etc. Any CPU 1 04 and operating system 1 10 known in the art may 
be used. Programs and data in memory 106 may be swapped into storage 108 as part of 
memory management operations. 

[00012] The network adapter 112 includes a network protocol layer 1 16 to send 
and receive network packets to and from remote devices over a network 1 1 8. The 

20 network 118 may comprise a Local Area Network (LAN), the Internet, a Wide Area 

Network (WAN), Storage Area Network (SAN), etc. Embodiments may be configured to 
transmit data over a wireless network or connection, such as wireless LAN, Bluetooth, 
etc. In certain embodiments, the network adapter 1 12 and various protocol layers may 
implement the Ethernet protocol including Ethernet protocol over unshielded twisted pair 

25 cable, token ring protocol, Fibre Channel protocol, Infmiband, Serial Advanced 

Technology Attachment (SATA), parallel SCSI, serial attached SCSI cable, etc., or any 
other network communication protocol known in the art. 
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[00013] A device driver 120 executes in memory 106 and includes network 
adapter 1 12 specific commands to communicate with a network controller of the network 
adapter 1 12 and interface between the operating system 1 10, applications 1 14 and the 
network adapter 1 12. The network controller can implement the network protocol layer 
5 116 and can control other protocol layers including a data link layer and a physical layer 
which includes hardware such as a data receiver. In an embodiment, employing the 
Ethernet protocol, the data transceiver could be an Ethernet transceiver. 

[00014] In certain implementations, the network controller of the network adapter 
1 12 includes a transport protocol layer as well as the network protocol layer 1 16. For 

10 example, the network controller of the network adapter 1 12 can include a TCP/IP offload 
engine (TOE) 121, in which transport layer operations are performed within the offload 
engine of the network adapter 1 12 hardware, as opposed to the device driver 120. 

[0001 5] The transport protocol operations include packaging data in a TCP/IP 
packet with a checksum and other information and sending the packets. These sending 

15 operations are performed by an agent which may be implemented with a TOE, a network 
interface card or integrated circuit, a driver, TCP/IP stack, a host processor or a 
combination of these elements. The transport protocol operations also include receiving 
a TCP/IP packet from over the network and unpacking the TCP/IP packet to access the 
payload or data. These receiving operations are performed by an agent which, again, 

20 may be implemented with a TOE, a driver, a host processor or a combination of these 
elements. 

[00016] The network layer 1 16 handles network communication and provides 
received TCP/IP packets to the transport protocol layer of the offload engine 121. The 
transport protocol layer interfaces with the device driver 120 and performs additional 
25 transport protocol layer operations, such as processing the content of messages included 
in the packets received at the network adapter 1 12 that are wrapped in a transport layer, 
such as TCP and/or IP, the Internet Small Computer System Interface (iSCSI), Fibre 
Channel SCSI, parallel SCSI transport, or any transport layer protocol known in the art. 
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The transport offload engine 121 can unpack the payload from the received TCP/IP 
packet and transfer the data to the device driver 120, an application 1 14, the operating 
system 1 10 or other destination within the system 102. 

[00017] In certain implementations, the network adapter 1 12 can further include 
5 an RDMA protocol layer as well as the transport protocol layer of the offload engine 121. 
For example, the network adapter 1 12 can implement an RDMA offload engine, in which 
RDMA layer operations are performed within the offload engines of the RDMA protocol 
layer implemented within the network adapter 1 12 hardware, as opposed to the device 
driver 120. 

10 [0001 8] Thus, for example, an application 1 14 transmitting messages over an 

RDMA connection can transmit the message through the device driver 120 and the 
RDMA protocol layer of the network adapter 112. The data of the message can be sent 
to the transport protocol layer of the offload engine 121 to be packaged in a TCP/IP 
packet before transmitting it over the network 1 18 through the network protocol layer 

15 116 and other protocol layers including the data link and physical protocol layers. 

[00019] The memory 106 further includes file objects 124, which also may be 
referred to as socket objects, which include information on a connection to a remote 
computer over the network 118. The application 1 14 uses the information in the file 
object 124 to identify the connection. The application 1 14 would use the file object 124 

20 to communicate with a remote system. The file object 124 may indicate the local port or 
socket that will be used to communicate with a remote system, a local network (IP) 
address of the computer 102 in which the application 1 14 executes, how much data has 
been sent and received by the application 1 14, and the remote port and network address, 
e.g., IP address, with which the application 1 14 communicates. Context information 126 

25 comprises a data structure including information the device driver 120, operating system 
1 10 or an application 1 14 maintains to manage requests sent to the network adapter 1 12 
as described below. 
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[00020] In the illustrated embodiment, the CPU 104 programmed to operate by 
the software of memory 106 including one or more of the operating system 1 10, 
applications 1 14, and device drivers 120 provides a host which interacts with the network 
adapter 1 12. Accordingly, a data send and receive agent includes the transport protocol 
layer of the offload engine 121 and the network protocol layer 116 of the network 
interface 112. However, the data send and receive agent may be implemented with a 
TOE, a network interface card or integrated circuit, a driver, TCP/IP stack, a host 
processor or a combination of these elements. 

[00021] The computer 102 includes an iSCSI target controller 130 which receives 
read and write commands over the network 118 from an initiator device 132, and in 
response reads data from and writes data to the storage 108. The initiator 132 may be a 
client computer, server or storage controller, for example. In the illustrated embodiment, 
the read and write commands are SCSI commands encapsulated in iSCSI packets sent 
over the network 1 18 although it is appreciated that other protocols may be used as well. 
The iSCSI target controller 130 includes an iSCSI protocol layer 131 and may be 
implemented as hardware , software, firmware of any combination thereof. For example, 
the target controller 130 may be implemented in hardware having a processor separate 
from the CPU 104. Also, the target controller 130 may be implemented in software such 
as in the operating system 1 10 or in a device driver such as a controller driver operating 
in the memory 106. The computer 102 includes a storage controller for the storage 108, 
which may be implemented with the iSCSI target controller 130 or may be implemented 
in separate hardware, software, firmware or any combination thereof. 

[00022] Associated with the iSCSI target controller 130 is a cache 134 in which 
target read data may be cached by a cache manager 136 in anticipation of that cached 
data satisfying the next read operation from the initiator 132. The particular caching 
technique used may depend upon the application being performed. The cache 134 may 
be a part of the host memory 106 or may be a separate memory coupled to the iSCSI 
target controller 130. The cache manager 136 may be implemented as hardware , 
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software, firmware of any combination thereof. For example, the cache manager 136 
may be implemented in storage controller hardware and include a processor separate 
from the CPU 104. Also, the cache manager 136 may be implemented in the network 
adapter 1 12 or in a device driver such as a storage controller driver or a network adapter 
5 driver 120. 

[00023] FIG. 2 illustrates a format of an iSCSI network packet 150 received at 
or transmitted by the network adapter 1 12. The network packet 150 is implemented in a 
format understood by the network protocol layer 1 16, such as the IP protocol. The 
network packet 150 may include an Ethernet frame that would include additional 

10 Ethernet components, such as a header and error checking code (not shown). A transport 
packet 152 is included in the network packet 150. The transport packet 152 is capable of 
being processed by the transport protocol layer of the offload engine 121 in accordance 
with the TCP protocol. The packet 152 may be processed by other layers in accordance 
with other protocols including Internet Small Computer System Interface (iSCSI) 

1 5 protocol, Fibre Channel SCSI, parallel SCSI transport, etc. The transport packet 1 52 
includes payload data 154 as well as other transport layer fields, such as a header and an 
error checking code. The payload data 154 includes the underlying content being 
transmitted, e.g., commands, status and/or data. The driver 120, operating system 1 10 or 
an application 1 14 may include a device layer, such as a SCSI driver or layer to process 

20 the content of the payload data 154 and access any status, commands and/or data therein. 

[00024] In the example of FIG. 2, the payload data 154 of the transport packet 152 
includes one or more iSCSI Protocol Data Units (PDU) 160, each of which has an iSCSI 
header 162 segments; an iSCSI header digest 164 comprising a CRC code for use in error 
checking the iSCSI header 162 segment; an optional iSCSI data segment 166; and an 

25 optional iSCSI data digest 168 comprising a CRC code for use in error checking the 

iSCSI data segment 166. The iSCSI header 162 includes an opcode that indicates the type 
of operation being transmitted by the transmitting device. There are initiator opcodes and 
target opcodes. 
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[00025] FIG. 3a illustrates certain of the information included in the iSCSI header 
162 when the packet 150 is transmitted by an initiator, such as the initiator 132, and 
includes a SCSI command. The initiator iSCSI header 180 has an opcode field 182 for 
initiator opcodes and control information, a logical unit number (LUN) 184 indicating a 
5 LUN against which the SCSI command operates, and a SCSI Command Descriptor Block 
(CDB) 186 specifying the specific SCSI command that is to be processed by the target 
into a SCSI command which is sent to the storage 108. 

[00026] The network adapter 1 12 can unpack the iSCSI Protocol Data unit 160 
from the packet sent by the initiator 132. If the packet passes the iSCSI check of the 

10 iSCSI CRC codes, the iSCSI Protocol Data unit 160 is forwarded to the iSCSI protocol 
layer 131 of the iSCSI target controller 130. In the illustrated embodiment, the network 
adapter 1 12 and the iSCSI target controller 130 are coupled to each other by a system bus 
187 over which data is passed. The iSCSI protocol layer 131 translates the iSCSI 
commands and iSCSI data sequences received from the network adapter 1 12 to SCSI 

15 commands and SCSI data sequences. In addition, the iSCSI protocol layer 131 forwards 
the SCSI commands to the storage 108 to perform the read or write operations requested 
by the initiator 132. 

[00027] In response to an iSCSI packet from the initiator 132, the iSCSI protocol 
layer 131 of the iSCSI target controller 130 also prepares response data and status 

20 information which are packaged into iSCSI packets to be sent by the sending agent to the 
initiator 132. FIG. 3b illustrates certain of the information included in the iSCSI header 
162 when the packet 150 is transmitted by a target device, such as the iSCSI target 
controller 130, in response to a request by the initiator, such as the initiator 132 The 
target iSCSI header 190 includes, among other things, an opcode field 192 for target 

25 opcodes and control information; a status field 194 indicating the SCSI status of the 

received command, e.g., good, check condition, busy, etc.; and response data 196, such as 
read target data to return in response to a SCSI read request. The target iSCSI header 190 
including the target read data requested by the initiator 132 are transmitted by the iSCSI 
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target controller 130 over the system bus 187 to the network adapter 1 12 to be packaged 
in a suitable packet for transmission back to the initiator 132 over the network 118. 

[00028] In accordance with one aspect of the illustrated embodiments, the network 
adapter 1 12 has associated with it, a cache 200, an example of which is illustrated in FIG. 
5 4. The cache 200 can be located as a physical part of the network adapter 1 12 or may be 
coupled to the network adapter 1 12 through a suitable memory controller, for example. 
A cache manager, such as the cache manager 136 of the iSCSI target controller 130, can 
temporarily store target read data in the cache 200 of the network adapter 1 12 in 
anticipation of that cached data satisfying the next read operation in the queue from the 

10 initiator 132. In another aspect, the network adapter 1 12 includes a storage command 
protocol layer, which, in the illustrated embodiment is at least a partial iSCSI protocol 
layer 202. The iSCSI protocol layer 202 can process SCSI commands such as read 
commands encapsulated in an iSCSI packet, and respond to the initiator 132 with read 
data from the network adapter cache 200, if the data cached in the cache 200 satisfies the 

15 read request from the initiator 132. As a consequence, the transmission of iSCSI 

commands over the network bus 187 to the iSCSI target controller 130 can be avoided, in 
some circumstances, to improve target efficiency. In the illustrated embodiment, the 
iSCSI protocol layer 202 and the transport protocol layer are implemented using a micro 
or offload engine such as the TOE 121. 

20 [00029] FIGs. 5 and 6 show an example of logic for responding to storage 

commands in a network adapter such as the network adapter 112. In the illustrated 
embodiment, the network adapter 1 12 receives (block 210) from the network 118 a 
packet and processes it in accordance with the network protocol layer 1 16, the transport 
protocol layer of the offload engine 121 and the iSCSI read command protocol layer 202 

25 as described below. If it is determined (block 212) that the received packet includes an 
iSCSI Protocol Data Unit (PDU) 154, the SCSI command is extracted (block 214) by the 
transport layer of the offload engine 121 or the iSCSI protocol layer 202. However, if 
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the Protocol Data Unit does not pass the iSCSI error check using the iSCSI error 
checking codes, the packet is discarded and a retransmit request is made. 

[00030] A determination (block 216) is also made by the iSCSI protocol layer 202 
as to whether the extracted SCSI command is a read command. If so, a determination 
5 (block 218) is made by the iSCSI protocol layer 202 as to whether the target data 

requested to be read by the extracted SCSI read command is already waiting in the cache 
200 of the network adapter 1 12. In the illustrated embodiment, the cache 200 for the 
offload engine of the network adapter 1 12, includes in addition to read data blocks 230a, 
230b . . . 230n (FIG. 4) cached in the memory 202 by the cache mana^r 136, the target 

10 addresses 232a, 232b . . . 232n of the storage 108 at which each data block 230a, 230b 
. . . 230n, respectively was stored in the storage 108. By comparing the target address of 
the read command extracted from the received protocol data unit, to the target addresses 
232a, 232b . . . 232n stored in the offload engine cache 200, a determination (block 218) 
may be made as to whether the target data of the read command is within the cache 200. 

15 Thus, if the read command target address matches the tar^t address of one of the blocks 
230a, 230b . . . 230n of target data stored in the cache, the data block of blocks 230a, 230b 
... 230n corresponding to the matching address is the target data requested by the 
extracted SCSI read command. 

[00031] If so, the SCSI read command may be processed (block 240) using the 

20 offload engine of the network adapter 1 12 rather than the iSCSI target controller 130. 
FIG. 6 shows an example of operations of the iSCSI protocol layer 202 including the 
network adapter 1 12 offload engine in processing the extracted read command. In the 
illustrated embodiment, the iSCSI protocol layer 202 of the network adapter 112 informs 
(block 242) the cache manager 136 that a "hit" was made, that is, that the target data of 

25 the extracted read command was found in the cache 200. The cache manager 136 may 
use this positive feedback to assist in the operation of the read ahead technique being 
used to transfer data to the cache 200 in anticipation of upcoming read operations. As 



12 



Docket No. PI 7722 
Firm No. 0077.0049 

previously mentioned, the particular read ahead technique utilized by the cache manager 
managing the cache 200 may vary, depending upon the particular application. 

[00032] A determination (block 244) is made as to whether the present read 
command is associated with a different iSCSI session In accordance with the iSCSI 
5 protocol, the iSCSI target controller 130 includes a state machine which can maintain a 
plurality of sessions with one or more initiators and can maintain a plurality of 
connections within each session. The iSCSI protocol layer 131 of the iSCSI target 
controller 130 maintains the state values of the different iSCSI connections and sessions. 
In accordance with another aspect of the illustrated embodiment, the iSCSI protocol layer 

10 202 of the network adapter 1 12 similarly can maintain appropriate state values of an 

iSCSI connection and session when responding to a read request. As explained in greater 
detail below, the iSCSI protocol layer 202 of the network adapter 1 12 and the iSCSI 
protocol layer 131 of the iSCSI target controller 130 can synchronize their respective 
session and connection state variables as appropriate. 

1 5 [00033] If it is determined (block 244) that the present read command is not 

associated with a different iSCSI session, the iSCSI protocol layer 202 of the network 
adapter 1 12 can respond (block 246) to the extracted SCSI read command by reading the 
target data from the offload engine cache 200. In addition, the iSCSI protocol layer 202 
increments (block 248) the appropriate values of the iSCSI connection and session state 

20 variables when responding to the read request. For example, a unique sequence number 
may be assigned each request which is provided by an initiator in a session. This 
sequence number may be maintained by the iSCSI protocol layer 202 of the network 
adapter 1 12 and incremented for each read request handled by the iSCSI protocol layer 
202 of the network adapter 1 12. 

25 [00034] In addition, the iSCSI protocol layer 202 of the network adapter 112 

translates (block 250) status information and the target data read from the offload engine 
cache 200 into one or more iSCSI Data and Status sequences. Each iSCSI Data and 
Status sequence is encapsulated into an iSCSI protocol data unit which is encapsulated in 
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a transport packet etc. by the iSCSI protocol layer 202, the transport protocol layer of the 
offload engine 121 and by the network protocol layer 1 16, and sent (block 252) to the 
requesting initiator in response to the read request. The iSCSI protocol layer 202 also 
maintains a flag which is set (block 254) when the last packet received contains a read 
5 request which was responded to by the iSCSI protocol layer 202 of the network adapter. 
[00035] As shown in FIG. 5, the processing of the packets by the network adapter 
112 continues in this manner so long as the next packet received (block 210), contains a 
SCSI read request (block 216), the target data of the read request can be found (block 
218) in the offload engine cache 200 and the read command is part of the same session 

10 (block 244, FIG. 6). However, if the next packet received contains a read request which 
relates to a different session (block 244), a determination (block 260) is made as to 
whether the offload engine iSCSI process flag has been set, that is, whether the last 
packet processed was a packet corlaining a read request which was processed by the 
iSCSI protocol layer 202 . If so, the session and connection state variable values of the 

15 iSCSI protocol layer 131 of the iSCSI target controller 130 are synchronized (block 262) 
to those of the iSCSI protocol layer 202 of the network adapter 1 12 for the prior session. 

[00036] The offload engine iSCSI command processing flag is reset (block 264) 
and the session and connection state variable values of the iSCSI protocol layer 202 of 
the network adapter 1 12 are synchronized (block 266) to those of the iSCSI protocol 

20 layer 13 1 of the iSCSI target controller 130 for the next session. The read request is then 
processed (blocks 246-254) as set forth above. 

[00037] If the next packet (block 210, FIG. 5) does not contain an iSCSI protocol 
data unit (block 212), the packet is processed (block 270) as a non-iSCSI packet by the 
transport protocol layer of the offload engine 121. If the next packet (block 2 1 0) does 

25 contain an iSCSI protocol data unit (block 212) but the encapsulated SCSI command is 
not a read command (block 216), a determination (block 272) is made as to whether the 
offload engine iSCSI process flag has been set, that is, whether the last packet processed 
was a packet containing a read request which was processed by the iSCSI protocol layer 
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202. If not, the iSCSI protocol data unit is forwarded (block 274) over the system bus 
187 to the iSCSI protocol layer 131 of the iSCSI target controller 130 to be processed. If 
the offload engine iSCSI process flag has been set , that is, it is determined (block 272) 
that the last packet processed was a packet containing a read request which was processed 
5 by the iSCSI protocol layer 202, the session and connection state variable values of the 
iSCSI protocol layer 131 of the iSCSI target controller 130 are synchronized (block 284) 
to those of the iSCSI protocol layer 202 of the network adapter 1 12 for the prior session. 
The offload engine iSCSI command processing flag is reset (block 286) and the iSCSI 
protocol data unit is forwarded (block 274) to the iSCSI protocol layer 131 of the iSCSI 

10 target controller 1 30 to be processed. 

[00038] If the next packet (block 210) does contain an iSCSI protocol data unit 
(block 212) and the encapsulated SCSI command is a read command (block 216), but it is 
determined (block 218) that the target data requested to be read by the extracted SCSI 
read command is not in the cache 200 of the network adapter 112, the cache manager 136 

15 is informed (block 288) of the "miss" that is, that the target data of the extracted read 

command was not found in the cache 200. The cache manager 136 may use this negative 
feedback to assist in determining the appropriate data to read ahead and transfer to the 
cache 200 in anticipation of upcoming read operations. 

[00039] Again, a determination (block 272) is made as to whether the offload 

20 engine iSCSI process flag has been set, that is, whether the prior packet processed was a 
packet containing a read request which was processed by the iSCSI protocol layer 202. If 
not, the iSCSI protocol data unit is forwarded (block 274) to the iSCSI protocol layer 131 
of the iSCSI target controller 130 to be processed. If the offload engine iSCSI process 
flag has been set, that is, it is determined (block 272) that the prior packet processed was 

25 a packet containing a read request which was processed by the iSCSI protocol layer 202, 
the session and connection state variable values of the iSCSI protocol layer 131 of the 
iSCSI target controller 130 are synchronized (block 284) to those of the iSCSI protocol 
layer 202 of the network adapter 1 12 for the prior session. The offload engine iSCSI 
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command processing flag is reset (block 286) and the iSCSI protocol data unit is 
forwarded (block 274) to the iSCSI protocol layer 131 of the iSCSI target controller 130 
to be processed. 

Additional Embodiment Details 

[00040] The described techniques for managing data read operations may be 
implemented as a method, apparatus or article of manufacture using standard 
programming and/or engineering techniques to produce software, firmware, hardware, or 
any combination thereof. The term "article of manufacture" as used herein refers to code 
or logic implemented in hardware logic (e.g., an integrated circuit chip, Programmable 
Gate Array (PGA), Application Specific Integrated Circuit (ASIC), etc.) or a computer 
readable medium, such as magnetic storage medium (e.g., hard disk drives, floppy disks,, 
tape, etc.), optical storage (CD-ROMs, optical disks, etc.), volatile and non- volatile 
memory devices (e.g., EEPROMs, ROMs, PROMs, RAMs, DRAMs, SRAMs, firmware, 
programmable logic, etc.). Code in the computer readable medium is accessed and 
executed by a processor. The code in which preferred embodiments are implemented 
may further be accessible through a transmission media or from a file server over a 
network. In such cases, the article of manufacture in which the code is implemented may 
comprise a transmission media, such as a network transmission line, wireless 
transmission media, signals propagating through space, radio waves, infrared signals, etc. 
Thus, the "article of manufacture" may comprise the medium in which the code is 
embodied. Additionally, the "article of manufacture" may comprise a combination of 
hardware and software components in which the code is embodied, processed, and 
executed. Of course, those skilled in the art will recognize that many modifications may 
be made to this configuration without departing from the scope of the present invention, 
and that the article of manufacture may comprise any information bearing medium 
known in the art. 

[00041] In the described implementations, a transport protocol layer of the 
offload engine 121 and at least partial iSCSI protocol layer 202 were implemented in the 
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network adapter 1 12 hardware. In alternative implemertations, at least a portion of the 
protocol layers may be implemented in the device driver 120, host memory 106, iSCSI 
target controller 130 or CPU 104. 

[001] In the described embodiments, various protocol layers and operations of those 
protocol layers were described. The operations of each of the various protocol layers 
may be implemented in hardware, firmware, drivers, operating systems, applications or 
other software, in whole or in part, alone or in various combinations thereof 

[00042] In the described embodimerts, the packets are transmitted from a remote 
computer over a network. In alternative embodiments, the transmitted and received 
packets processed by the protocol layers or device driver may be transmitted to a 
separate process executing in the same computer in which the device driver and protocol 
layers execute. In such embodiments, the network adapter is not used as the packets are 
passed between processes within the same computer and/or operating system. 

[00043] In certain implementations, the device driver and network adapter 
embodiments may be included in a computer system including a storage controller, such 
as a SCSI, Integrated Drive Electronics (IDE), Redundant Array of Independent Disk 
(RAID), etc., controller, that manages access to a non- volatile storage device, such as a 
magnetic disk drive, tape media, optical disk, etc. In alternative implementations, the 
network adapter embodiments may be included in a system that does not include a 
storage controller, such as certain hubs and switches. 

[00044] In certain implementations, the device driver and network adapter 
embodiments may be implemented in a computer system including a video controller to 
render information to display on a monitor coupled to the computer system including the 
device driver and network adapter, such as a computer system comprising a desktop, 
workstation, server, mainframe, laptop, handheld computer, etc. Alternatively, the 
network adapter and device driver embodiments may be implemented in a computing 
device that does not include a video controller, such as a switch, router, etc. 
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[00045] In certain implementations, the network adapter may be configured to 
transmit data across a cable connected to a port on the network adapter. Alternatively, 
the network adapter embodiments may be configured to transmit data over a wireless 
network or connection, such as wireless LAN, Bluetooth, etc. 
5 [00046] The illustrated logic of FIGs. 5-6 show certain events occurring in a 

certain order. In alternative embodiments, certain operations may be performed in a 
different order, modified or removed. Moreover, steps may be added to the above 
described logic and still conform to the described embodiments. Further, operations 
described herein may occur sequentially or certain operations may be processed in 

10 parallel. Yet further, operations may be performed by a single processing unit or by 
distributed processing units. 

[00047] FIG. 4 illustrates information used to manage read operations. In 
alternative implementation, these data structures may include additional or different 
information than illustrated in the figures. 

15 [00048] FIG. 7 illustrates one implementation of a computer architecture 300 of 

the network components, such as the hosts and storage devices shown in FIG. 1. The 
architecture 300 may include a processor 302 (e.g., a microprocessor), a memory 304 
(e.g., a volatile memory device), and storage 306 (e.g., a non-volatile storage, such as 
magnetic disk drives, optical disk drives, a tape drive, etc.). The storage 306 may 

20 comprise an internal storage device or an attached or network accessible storage. 
Programs in the storage 306 are loaded into the memory 304 and executed by the 
processor 302 in a manner known in the art. The architecture further includes a network 
adapter 308 to enable communication with a network, such as an Ethernet, a Fibre 
Channel Arbitrated Loop, etc. Further, the architecture may, in certain embodiments, 

25 include a video controller 309 to render information on a display monitor, where the 
video controller 309 may be implemented on a video card or integrated on integrated 
circuit components mounted on the motherboard. As discussed, certain of the network 
devices may have multiple network cards or controllers. An input device 310 is used to 
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provide user input to the processor 302, and may include a keyboard, mouse, pen-stylus, 
microphone, touch sensitive display screen, or any other activation or input mechanism 
known in the art. An output device 312 is capable of rendering information transmitted 
from the processor 302, or other component, such as a display monitor, printer, storage, 
etc. 

[00049] The network adapter 308 may be implemented on a network card, such 
as a Peripheral Component Interconnect (PCI) card or some other I/O card, or on 
integrated circuit components mounted on the motherboard. 

[00050] The foregoing description of various embodiments of the invention has 
been presented for the purposes of illustration and description. It is not intended to be 
exhaustive or to limit the invention to the precise form disclosed. Many modifications 
and variations are possible in light of the above teaching. It is intended that the scope of 
the invention be limited not by this detailed description, but rather by the claims 
appended hereto. The above specification, examples and data provide a complete 
description of the manufacture and use of the composition of the invention. Since many 
embodiments of the invention can be made without departing from the spirit and scope of 
the invention, the invention resides in the claims hereinafter appended 
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